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IMAGE PROCESSING COMPUTER SYSTEM 
FOR PHOTOGRAMMETRIC ANALYTICAL MEASUREMENT 

BACKGROUND OP THE INVENTION 
5 1. Field of the Invention 

The present: invention relates to an image-processing 
computer system for a photogrammetxic analytical measurement r 
O in which a survey map is electronically produced based on a 
7" pair of photographed pictures obtained at two different 
S) photographing positions . 
R 2 . Description of the Related Art 

For example, photograannetry is carried out at a traffic 
y- accident spot- The traffic accident spot is photographed by 
Q an electronic still video digital camera in at least two 
f§5 different positions, and a survey map of the traffic accident 
spot is produced based on a pair of photographed pictures 
obtained at the different positions/ as disclosed in, for 
example/ Unexamined Japanese Patent Publications No ,10-221072 
and No, 10-293026. 
20 Before accurately scaled distances and lengths can be 

reproduced on the survey map, a standard measurement scale or 
target must be recorded together with the photographed objects 
in the pictures. The target is disclosed in, for example. 
Unexamined Japanese Patent Publications No . 10-141951 , No. 10- 
25 170263, No. 10-185562, So. 10-185563/ No . 10-293026 , No. 10-307025 
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and No. 11-295065. 

For the production of the survey map, a two-dimensional 
coordinate system is defined on each of the pictures, and two- 
dimensional positions of the objects, which are recorded on 
5 each picture, are determined by the two-dimensional coordinate 
system. Also, a three-dimensional coordinate system is 
defined on the target, and three-dimensional positions of the 
O recorded objects aire determined based on the two-dimensional 

positions of the objects with respect to the three-dimensional 
50 coordinate system. Accordingly , it is possible to produce a 
O survey map by projecting the three-dimensional coordinates, 

representing the objects, on one of the three planes defined 
yl by the three-dimensional system* Of course, the production of 
O the survey map is performed using an image-processing computer 
EES system. 

For example, to produce a long portion of a roadway as 
a survey map, it is necessary to obtain plural pairs of 
pictures to cover the length of the roadway, and the target 
must be moved from one position to another position in the 

20 length of the roadway. In this case, a survey map section is 
produced based on each pair of pictures, and the survey map is 
obtained by successively connecting the survey map sections to 
each other. Of course, the production of all the survey map 
sections must be united with respect to a single three- 

25 dimensional coordinate system defined on the target located at 
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a previously-selected, position. Thus, whan the plural pairs 
of pictures are processed using the image-processing computer 
system by an operator to produce the survey map, it must be 
always known by the operator which target position each pair 
5 o£ pictures features and where each picture is photographed, 
resulting in facilitation of the production of the survey map- 
However, in reality, it is difficult to visually recognize the 
circumstances of a picture among other many pictures - 
O SUMMARY OF THE INVENTION 

flO Therefore, an object; of this invention is to provide an 

:- 0 image processing computer system for a photogrammetric 

□ analytical measurement, which is constituted such that the 

g"" circumstances of each picture to be processed to produce a 

fS survey map can be visually and easily recognized, resulting in 

f45 facilitation of the production of the survey map. 

In accordance with an aspect of the present invention, 
there is provided an image processing computer system for a 
photogrammetric analytical measurement in which a survey map 
is produced by connecting at least two sets of pictures 
20 featuring a photographed target located at a given target 

position. The image processing computer system comprises: a 
monitor that displays a scene including a picture-display area 
and an editing-display area; a first monitor controller that 
selectively displays only one picture in each set on the 
25 picture-display area of the scene; a second monitor controller 
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that transfers a displayed picture from the picture-display 
area to the editing-display area and vice versa; and a third 
monitor controller that visually displays? a connection 
relationship between pictures displayed on the editing-display 

5 area of the scene. 

In accordance with another aspect of the present 
invention, there is provided an image processing computer 
system for a photogrammetric analytical measurement in which a 
;LI survey map is produced by connecting a first group including 
31) at least a set of pictures featuring a photographed target 

loeated at a first target position and a second group 
JL including at least a set of pictures featuring a photographed 
41 : target located at a second target position to each other. The 
*f image processing computer system comprises ; a monitor that 
% displays a first sc^ne including a picture-display area and an 
editing-display area; a first monitor controller that 
selectively displays only one picture in a set included in the 
first group and only one picture in a set included in the 
second group, on the picture-display area of the first seen©; 
20 a second monitor controller that transfers a displayed picture 
from the picture-display area to the editing-display area and 
vice versa; and a third monitor controller that visually 
displays a connection relationship between pictures displayed 
on the editing-display area of the first scene, 
25 Preferably, a display of pictures on the picture- 
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display area and the editing-display area is performed at a 
reduced size. 

When each of the first and second groups includes at 
least two sets of pictures, all respective pictures, included 
5 in the sets forming each group, are displayed on the picture- 
display area in photographing order under control of the first 
monitor controller. When one of the respective pictures, 
O included in the sets forming each group, is transferred from 
B the picture-display area to the editing-area and vice versa, a 
3p transfer of the remaining pictures may be simultaneously 
performed under control of the second monitor controller. 
;? Also, when one of the respective pictures, included in 

m fche sets forming each group, is transferred from the picture- 
display area to the editing-area, a transfer of the remaining 
SS pictures may be simultaneously performed under control of the 
second monitor controller, and all the respective pictures, 
included in the sets forming the other group, may be displayed 
on the picture-display area under controller of the first 
monitor controller. 
20 The image processing computer system may further 

comprises a transfer-indicator that indicates a picture to be 
transferred from the picture-display area to the editing- 
display area and vice versa. In this case, a marker is 
displayed on the editing-display area under control of the 
25 second monitor controller to indicate a location, at which the 
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picture is to be transferred from the picture-display area to 
the editing-display area, when the picture is indicated by the 
transfer-indicator . 

Preferably, the marker comprises a frame representing 
5 an outline of the picture to be transferred from the picture- 
display area to the editing-display area, and is movable under 
control of the second monitor controller in the editing- 
O display area. 

En For the visual connection-relationship between pictures 

ffb displayed on the editing-display area of the first scene, a 

O connecting-strip is displayed on the editing-display area 

£ under control of the third monitor controller to indicate the 

3n connection relationship between the pictures displayed on the 

O editing-display area of the first scene- Preferably, the 

||5 connecting- strip is displayed as a strip connected between the 

centers of the two adjacent pictures at the back faces 

thereof - 

The image processing computer system may further 
comprise a fourth monitor controller that moves a picture, 

20 transferred from the picture-display area to the editing- 
display area, from one location to another location on the 
editing-display area, and a movement-indicator that indicates 
a picture to be moved on the editing-display area, A marker 
may be displayed on the editing-display area under control of 

25 the fourth monitor controller to indicate a location, at which 
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the picture is to be moved, when the picture is indicated by 
the movemen t~ indicator , Preferably, the maker concerned 
comprises a frame representing an outline of the picture to be 
moved on the editing-display area. 
5 The image processing computer system may further 

comprises a connection-indicator that indicates a picture, 
displayed on the picture-display area, and a picture, 
□ displayed on the editing-display area, to be connected to each 
f?; other when the former picture is transferred to the editing- 
iflO display area, and a fourth monitor controller that changes the 
R first scene of the monitor into a second scene in which a 
connection-processing for connecting the pictures to each 
S other is performed before the former picture is transferred to 
g the editing-display area. In this case, preferably , two 
3.5 pictures, included in a set forming the first group, and two 
pictures, included in a set forming the second group, are 
displayed on the second scene of the monitor under control of 
the fourth monitor controller for the connect ion -processing. 
Further, preferably, the two pictures, included in a set 
20 forming the first group, and the two pictures, included in a 
set forming the second group, have at least two common 
connecting- image-points for the connection -processing . 

In accordance with yet anther aspect of the present 
invention , there is provided an image processing method for a 
25 photogrammetric analytical measurement in which a survey map 
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is produced by connecting a first group including at least a 
set of pictures featuring a photographed target located at a 
first target position and a second group including at least a 
set of pictures featuring a photographed target located at a 
5 second target position to each other* The image processing 
method comprises steps of: displaying a scene, including a 
picture-display area and an editing-display area, on a 
™f monitor; selectively displaying only one picture in a set 
z: included in the first group and only one picture in a set 
30 included in the second group, on the picture-display area of 
y the scene; transferring a displayed picture from the picture- 
!L display area to the editing-display area; and visually 
yi displaying a connection relationship between pictures 
O displayed on the editing-display area of the scene. 
G5 In accordance with still yet another aspect of the 

present invention; there is provided a memory medium storing 
an image processing program for executing the above-mentioned 
method. 

BRIEF DESCRIPTION OF THE DRAWINGS 
20 The object and other objects of the present invention 

will be better understood from the following description, with 

reference to the accompanying drawings , in which; 

Figure 1 is a plan view of a roadway for explaining a 

photogrammetric analytical measurement, which is utilized by a 
25 photogrammetric image processing computer system according to 



FROM»»ii * 



2000$ 6fl29B(*)17:29/II17:27/M54801 158657 P 10 



the present: invention; 

Figure 2 is a conceptual schematic view showing an 

example of a format of a memory card, which is detachably held 

in an electronic still video digital camera utilized in the 
5 photogrammetric analytical measurement, and which is loaded in 

the photogrammetric image processing computer system according 

to the present invention; 
D Figure 3 is a block diagram of the photogrammetric 

m image processing computer system according to the present 
ffi) invention; 

g Figure 4 shows a conceptual perspective view showing a 

f positional relationship between the camera and a target when 
S performing a photographing operation at a first photographing 
™ position; 

JJ5 Figure 5 is a geometrical and conceptual illustration 

of the positional relationship shown in Fig, 4; 

Figure 6 is an actual view of a picture photographed at 
the first photographing position shown in Fig. 4; 

Figure 7 is a geometrical and conceptual illustration 
20 showing a transformation of a second scene coordinate system, 
defined on the target moved from the position shown in Fig. 4; 

Figure 8 is a view showing a connection -mode scene of a 
monitor included in the photogrammetric image processing 
computer system according to the present invention; 
25 Figure 9 is a view, similar to Fig, 8, showing the 
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connection-mode scene at an aspect different from Fig. 8; 

Figure 10 is a view, similar to Fig, 8, showing the 
connection -mode scene at another aspect different from Fig. 8; 
Figure 11 is a view of a scene changed from the 
5 connection-mode scene of the monitor shown in Fig* 10; 

Figure 12 is a view, similar to Fig. 8, showing the 
connection-mode scene at yet another aspect different from 
D Fig, 8; 

m Figure 13 is a view, similar to Fig. 8, showing the 

|f connection-mode scene at yet further another aspect different 
O from Fig. 8; 

s Figure 14 is a flowchart for an object-connecting 

m routine executed in the photogrammetric image processing 
p computer system according to the present invention; 
P? Figure 15 is a flowchart for a subroutine executed in 

step £100 of the object-connecting routine of Fig. 14; 

Figure 16 is a flowchart for a subroutine executed in 
step S200 of the object- connecting routine of Fig. 14; 

Figure 17 is a flowchart for a subroutine executed in 
20 step S300 of the object-connecting routine of Fig- 14; 

Figure 18 is a flowchart for. a subroutine executed in 
step S400 of the object- connecting routine of Fig- 14; 

Figure 19 is a flowchart for a subroutine executed in 
step S500 of the object-connecting routine of Fig- 14; 
25 Figure 20 is a flowchart for a subroutine executed in 

-10- 
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step S600 of the object-connecting routine of Fig, 14; 

Figure 21 is a flowchart for a subroutine executed in 
step S700 of the object-connecting routine of Pig. 14; 

Figure 22 is a flowchart for a subroutine executed in 
5 step S800 of the object- connecting routine of Fig. 14; 

Figure 23 is a flowchart for a subroutine executed in 
step SHOO of the subroutine of Fig. 21; 
O Figure 24 is a flowchart for a subroutine executed in 

ffi step S1200 of the subroutine of Fig. 21; 

P Figure 25 is a flowchart for a subroutine executed in 

Q step S1300 of the subroutine of Fig, 21; 

T Figure 26 is a flowchart for a subroutine executed in 

m step S1400 of the subroutine of Fig. 21; and 

S! Figure 27 is a flowchart for a subroutine executed in 

Sp step S1500 of the subroutine of Fig- 21. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 

With reference to Fig, 1, a roadway is shown as a plan 
view, by way of example, for explaining a photogrammetric 
analytical measurement which utilizes by a photogrammetric 

20 image processing computer system of the present invention. In 
this example, the roadway is photographed by an electronic 
still video digital camera 50 (Fig. 4) at eighteen 
photographing positions, which are represented by small solid 
circles indicated by references Ml to Ml 8, respectively. Each 
25 of the eighteen pictures, photographed at the photographing 
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positions Ml to M18, is processed by a control circuit of the 
digital camera 50, and is then stored as a frame of image data 
in a memory medium, such as an IC memory card, held in the 
camera 50. The memory card is loaded in the photogrammetric 
5 image processing computer system according to the present 

invention, and a survey map of the roadway is produced on the 
basis of the eighteen frames of image data read from the 
O memory card, as stated in detail hereinafter. 
m Each of the photographing positions Ml to M18 is 

||l defined as a back principal point M (Fig 4) of a photographing 
S optical system of the digital camera 50. As shown in Fig. l f 
7 an arrow is projected from each of the photographing positions 
m Ml to Ml 8 to indicate a photographing direction at the 
n corresponding photographing position (Ml, M2 , »• M17 ,M18) , The 
|ft photographing direction is defined as an orientation of an 
optical axis of the photographing optical system of the 
digital camera 50. 

The eighteen photographing operations are performed in 
the order of the photographing positions Ml to M18. Also, 
20 when each of the photographing operations is performed, an 

object to be surveyed is photographed together with a target, 
indicated by reference TG (Fig. 4) , which serves as a standard 
measurement scale. In Fig, 1, although three targets TG are 
shown, only one target TG is used. Respective bracketed 
25 references RFl, RP2 and RP3, appended to the references TG, 
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represents target positions at which the target TG is to be 
located. 

In the example of Fig- 1, the target TG is initially 
located at the first target position RPl, and the first, 
5 second, third, fourth, fifth and sixth photographing 

operations are performed at the positions Ml to M6, After the 
completion of the sixth photographing operation, the target TG 
is moved from the first target position RPl to the second 
target position RP2, and the seventh, eighth, ninth and tenth 
10 photographing operations are performed at the positions M7 to 

M10. After the completion of the tenth photographing 
L, operation , the target TG is further moved from the second 
*f_\ target position RP2 to the third target position RP3, and the 
Jf eleventh, twelfth, thirteenth , fourteenth, fifteenth, 
45 sixteenth, seventeenth and eighteenth photographing operations 
are performed at the positions Mil to MIS. 

The target TG is provided with a movement sensor for 
detecting the movement of the target TG, as disclosed in 
Unexamined Japanese Patent Publication No. 11-295065, and a 
20 tilt-angle sensor for detecting a tilt-angle of the target TG, 
as disclosed in Unexamined Japanese Patent Publication No. 10- 
185563. Whenever the target TG is moved from a position to 
another position, the movement sensor detects a movement of 
the target between the two positions, and outputs a signal 
25 representing the movement of the target TG, The tilt-angle 
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sensor detects a tilt-angle of the target TG to a horizontal 
plane when being located on the roadway, and outputs a tilt- 
angla signal representing the detected tilt-angle. 

The target TG is further provided with a signal 
5 processor for processing the respective signals output from 
the movement sensor and the tilt-angle sensor, and a radio 
transmitter for transmitting the processed signals to a 
0 receiver provided in the camera 50. The transmission of the 
5 signals from the radio transmitter is repeated at regular 
fp intervals of very short time. Whenever a photographing 

operation is performed by the camera 50, and the transmitted 
■ signals are retrieved from the receiver by the control circuit 
CD of the camera 50. The retrieved signals are processed by the 
Q control circuit of the camera 50, and are then stored in the 
ffi5 memory card, together with a corresponding frame of image data 
obtained by the photographing operation. 

An object to be surveyed is twice photographed by the 
camera 50 at two different photographing positions and in two 
different photographing directions. Namely, the two 
20 photographing operations are consecutively performed by the 
camera 50 with respect to the object to be surveyed, and a 
pair of pictures, on which the object to be surveyed is 
recorded, is obtained by the two consecutive photographing 
operations . 

25 In particular, while the target TG is located at the 
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first target position RP1, a first pair of pictures is 
obtained by the consecutive first and second photographing 
operations at the positions Ml and M2, a second pair of 
pictures is obtained by the consecutive third and fourth 
photographing operations at the positions M3 and M4, and a 
third pair of pictures is obtained by the consecutive fifth 
and sixth photographing operations M5 and M6. The first, 
second and third pairs of pictures form a first group of 
pictures featuring the first target position RF1 of the target 
TG. 

Also, while the target TG is located at the second 
target position RP2, a fourth pair of pictures is obtained by 
the consecutive seventh and eighth photographing operations at 
the positions M7 and M8, and a fifth pair of pictures is 
obtained by the consecutive ninth and tenth photographing 
operations at the positions M9 and M10 . The fourth and fifth 
pairs of pictures form a second group of pictures featuring 
the second target position RP2 of the target TG. 

Further, while the target TG is located at the third 
target position RP3, a sixth pair of pictures is obtained by 
the consecutive eleventh and twelfth photographing operations 
at the positions Mil and M12 , a seventh pair of pictures is 
obtained by the consecutive thirteenth and fourteenth 
photographing operations at the positions Ml 3 and M14, an 
eighth pair of pictures is obtained by the consecutive 
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fifteenth and sixteenth photographing operations M15 and M16, 
and a ninth pair of pictures is obtained by the consecutive 
seventeenth and eighteenth photographing operations at the 
positions Ml 7 and Ml 8 . The sixth, seventh, eighth and ninth 
5 pairs of pictures form a third group of pictures featuring the 
third target position RP3 of the target TG. 

In order for the production of the survey map of the 
=i roadway, nine survey map sections are produced on the basis of 
II the first, second, third, fourth, fifth, sixth, seventh, 
^ eighth and ninth pairs of pictures, respectively, and then are 
2 successively connected to each other , 

"° For the connection between one of the first, second and 

2 third map sections, derived from the first group of pictures, 
and one of the fourth and fifth map sections, derived from the 

ft second group of pictures, a first set of markers MKl and MK2 
is located between the first and second target positions RPl 
and RP2, and the first set of markers MKl and MK2 is 
photographed in at least one pair of pictures, included in the 
first group of pictures, and in at least one pair of pictures, 

20 included in the second group of pictures. 

Similarly, for the connection between one of the fourth 
and fifth map sections, derived from the second group of 
pictures, and one of the sixth, seventh, eighth and ninth map 
sections, derived from the third group of pictures, a second 
25 set of markers MK3 and MK4 is located between the second and 
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third target positions RP2 and RP3, and the second set of 
markers MK3 and MK4 is photographed in at least one pair of 
pictures, included in the second group of pictures, and in at 
least one pair of pictures, included in the third group of 
5 pictures * 

Xn Fxg. 1, respective bracketed references RCl and RC2 , 
appended to the references MKl and MK2, represent connection 
C points for connecting two survey map sections derived from the 
0} first and second groups of pictures. Similarly, respective 
GEO bracketed references RC3 and RC4 , appended to the references 
O KK3 and MK4 , represent connection points for connecting two 

survey map sections derived from the second and third groups 
gi of pictures* 

p In Fig. 1, although each of the markers MKl , MK2 , MK3 

fj5 and MK4 is shown as a small solid triangle, it may comprise a 
cone-shaped marker. In this case/ the connection point is 
represented by an apex of the cone-shaped marker. 

In the example of Fig. 1/ a single set of markers may 
be used for the two sets of markers (MKl and MK2 ; MK3 and 
20 MK4) . Of course/ in this case, the single set of makers are 
initially located between the first and second target 
positions RP1 and RF2, and is then moved to a location between 
the second and third target positions RP2 and RP3 after the 
photographing operations for the second group of pictures are 
25 completed* 
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Note, in Pig. 1, references WL indicate white lines 
painted along the sides of the roadway, and references WM 
indicate white traffic symbols painted on the roadway. 

Figure 2 conceptually shows a format of the IC memory 
5 card held in the camera 50. As shown in this drawing, a 

memory area of the memory card is sectioned into a plurality 
of memory-area sections, some of which are indicated by 
O references 2& n ,2' ro n-l' PD n ro n+l' an< * eac ** °^ memory- 

IP area sections {■», J?D n ^2/ 2D n-1 , PD n an< * PD n+l f includes an 
OK) image area IMD, a header area H and a margin area SF. Of 

0 course, the image area IMD is provided for storing a frame of 
s image data representing a photographed picture. The header 

01 area H is sectioned into subheader areas Hi, H2, H3 and H4 for 
p storing various particular data concerning the photographed 
Cf5 picture* The margin area SP is provided for distinguishing 

between the two adjacent memory area sections M> n and PD n+1 . 

The subheader areas HI is provided for storing a title 
data of the photographed picture, and the title data is input 
by manipulating character-inputting-switch buttons provided on 
20 a camera body of the camera 50, if necessary. 

The subheader area H2 is provided for storing two kinds 
of number data: a frame number data representing a 
photographing order and a target-position number data 
representing a target-position (RF1, RP2, KP3) of the target 
25 TG, 
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For the frame number data, a frame number counter is 
defined in the control circuit of the camera 50, and, for 
example, is initially set to be "0". Whenever a photographing 
operation is performed by the camera 50, the frame number 
5 counter is incremented by "1", and is stored as the frame 
number data in a corresponding subheader area H2 . For 
example, when the first photographing operation is completed 
□ at the position Ml, the frame number data is stored as u l" in 

the subheader area H2 of the first memory-area section PD X , and 
10 when the eighteenth photographing operation is completed at 
p the position M18, the frame number data is stored as "18" in 
the subheader area H2 of the eighteenth memory-area section 

p For the target-position number data, a target-position- 

j|5 number counter is defined in the control circuit of the camera 
50, and, for example, is Initially set to be "1*. Whenever a 
movement of the target TS from one position to another 
position is confirmed by detecting the movement-signal 
transmitted from the radio transmitter of the target TG, the 

20 target-position-number counter is incremented by u l n , and, 

whenever a photographing operation is completed by the camera 
50, a count number data of the target-position -number counter 
data is stored as the target-position number data in a 
corresponding subheader area H2. Thus , when each of the 

25 first, second, third, fourth, fifth and sixth photographing 
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operations is completed, the target-position number data is 
stored as M l" in the subheader area H2 of each memory-area 
section (H^, PD 6 ) - Also, when each of the seventh / eighth, 
ninth and tenth photographing operations is completed, the 
5 target-position number data is stored as "2 W in the subheader 
area H2 of each memory-area section (PD 7 , PD 10 ) . Further, 
when each of the eleventh, twelfth, thirteenth, fourteenth, 

£3 fifteenth, sixteenth, seventeenth and eighteenth photographing 

01 operations is completed, the target-position number data is 

OS) stored as "3" in the subheader area H2 of each memory- area 

Q section (PD 13L , * , PD i8* • 

In short, the photographed pictures, included in the 

pi first group, are featured by as the target-position number 
O data; the photographed pictures, included in the second group, 
£§5 are featured by "2" as the target-position number data; and the 
photographed pictures, included in the third group, are 
featured by "3" as the target-position number data. 

The subheader area H3 is provided for storing a 
photographing date data, a focus -distance data, a horizontal 

20 view-angle data, a vertical view-angle data, a resolving-power 
data of a CCD < charge-coupled device) image sensor, used in 
the camera 50, and so on. These data are automatically stored 
in the subheader area H3 by the control circuit of the camera 
50 whenever a photographing operation is completed. 

25 The subheader area H4 is provided for storing the tilt- 
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angle data of the target TG, which are derived from a tilt- 
angle signal transmitted from the radio transmitter of the 
target TG. Namely, as mentioned above, whenever a 
photographing operation is performed by the camera 50, and the 

5 tilt-angle signal is retrieved from the receiver by the 

control circuit of the camera 50, and the retrieved signal is 
processed by the control circuit of the camera 50, thereby 

C producing the tilt-angle data to be stored in the subheader 

m H4 . 

JQ With reference to Fig. 3, the photograrametric image 

D processing computer system according to the present invention 

is shown as a. block diagram* 
5 The image processing computer system comprises : a 

=2 central processing unit (CPU) 14; a display device 10, such as 
J| a CRT monitor; a display controller 16 for controlling the 
monitor 10; a display memory 20 for storing image data on 
which a scene to be displayed on the monitor 10 is based; an 
input device 12 including a keyboard and a mouse; an input- 
device controller 17 for controlling the input device 12; a 
20 memory-card driver 18 for loading the memory card, indicated 
by reference 13; and a working memory 19 used as a cash memory 
when executing calculations and processings in the CPU 14. 
The input-device controller 17, the working memory 19, the 
display memory 20, the memory-card driver 18 and the display 
25 controller 16 are connected to the CPU 14 via a bus 15. 
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As conceptually shown in Fig- 3, the CPU 14 includes an 
input-state managing section 41, a display-state managing 
section 42, a connection-processing section 43, and a data- 
managing section 44 . 
5 The input-state managing section 41 manages various 

information data and command data input through the input 
device 12. Fox example, when a cursor or pointer is moved on 
n thB monitor by manipulating the mouse of the input device 12 , 
S the movement of the pointer is managed by the input- state 
IS managing section 41. Also, by the input-state managing 
h[ section 41, it is monitored whether character code data is 
input through the keyboard of the input device 12, and, when 
the character code data is input, the character code data is 
ti converted into image data, which is output to the display 

i5 memory 20* 

The display-state managing section 42 manages a scene 
to be displayed on the monitor 10. For example, when at least 
a part of the scene displayed on the monitor 10 is changed, 
the change of the scene is managed by the display-state 

20 managing section. Namely, writing of image data in the 

display memory 20 is controlled by the display-state managing 
section 42, thereby changing the scene displayed on the 
monitor 10. The display controller 16 repeatedly reads the 
image data from the display memory 20 at a regular interval of 

25 given short time, and converts the read image data into a 
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three primary (red, green and blue) video data. 

The connection-processing section 43 processes the 
above-mentioned connection of the survey map sections to each 
other, thereby producing the survey map of the roadway, as 
5 stated in detail hereinafter. 

The data-managing section 44 manages various data read 
from the memory card 13 through the memory- card driver 18, 
O survey map data, various data necessary for producing the 
£H survey map data and so on. 

m After the eighteen photographing operations are 

CI completed by the camera 50 at the photographing positions Ml 

to M18, as shown in Fig. 1, the memory card 13 is removed from 
51 the camera 50, and is then loaded in the memory-card driver 
Q 18. Of course, the loaded memory card 13 stores the eighteen 
W frames of image data obtained by the eighteen photographing 

operations performed at the positions Ml and M18 . 

The eighteen frames of image data are read from the 

memory card 13 through the memory-card driver 18, and are once 

stored in the working-memory 19. Then, each of the eighteen 
20 photographing positions Ml, M2, Ml 7 and M18 is spatially 

determined with respect to the target TG on the basis of the 

corresponding frame of image data. 

Referring to Figs. 4 to 6, the spatial determination of 

the first photographing position Ml with respect to the target 
25 TG will be representatively explained. 
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Figure 4 shows a positional relationship between the 
camera 50 and the target TG when performing the photographing 
operation at the first photographing position Ml - In the 
positional relationship of Fig. 4, of course, the target TG is 
5 within a view-angle defined by the photographing lens system 
of the camera 50 , boundaries of the view-angle being indicated 
by references FF. Also, the optical axis o£ the photographing 

0 len$ system of the camera 50 is indicated by reference Ol . As 

01 stated hereinbefore , the first photographing position Ml is 
f§ defined as the back principal point M of the photographing 

*5 optical system of the camera SO. As is apparent from Fig* 4, 
' the target TG has an ii-shaped configuration , and is provided 
m with reference points 32, 34 and 36, A line segment between 
}Z the reference points 32 and 34 is perpendicular to a line 
p? segment between the reference points 34 and 36 , and both the 

line segments have a same length. 

Referring to Fig. 5, the positional relationship of 

Fig* 4 is geometrically and conceptually illustrated. In this 

drawing, reference F indicates an image plane defined by the 
20 photographing leas system of the camera 50, and the picture 

formed on the image plane F is indicated by reference IM1. 

The picture XM1, of course, corresponds to the first picture 

photographed at the position Ml (Fig. 1) , and is actually 

shown in Fig. 6. 

25 As shown in Fig. 5, the optical axis 01 passes through 
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a center C of the image plane F or picture IMl, and a distance 
between the center C and the back principal point M (Ml) is 
defined as a focal distance f . A three-dimensional X s -Y s -Z s 
coordinate system is defined on the target TG located at the 
5 first target position RPl, as shown in Fig. 5, Namely, the 
origin of the X s -Y g -Z s coordinate system is at the reference 
point 34 of the target TG, the X g -aacis coincides with the line 
O segment between the reference points 32 and 34, and the Z s -axis 
CP coincides with the line segment between the reference points 
IB 34 and 36. Of course, the Y g -axis is perpendicular to both the 
O X s - and Z 9 ~axes. Note, the X a -Y a -Z 3 coordinate system, defined 

on the target TG located at the first target position RPl, is 
S referred to as a first scene coordinate system hereinafter. 
O The survey map is produced by projecting three- 

|f dimensional coordinates representing an image point on a plane 
defined by the x g - and z s ~axes of the first scene coordinate 
system (X g -Y s -Z s ) , and the plane concerned must be horizontal 
before the production of the survey map can be properly 
performed. Nevertheless, the target TG cannot necessarily be 
20 horizontally positioned on the roadway when being located at 
the first target position RPl- Thus, if the target TG is 
tilted with respect to a horizontal plane, the plane concerned 
is also tilted. The tilt of the target TG is corrected on the 
basis of the tilt-angle data, which is derived from the tilt- 
25 angle signal transmitted from the radio transmitter of the 
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target TG. Accordingly, although the target TG is tilted, it 
is possible to properly perform the definition of the first 
scene coordinate system (X g -Y g -Z g ) . 

In Fig. 5, a distance between the reference points 32 
5 and 34 is represented by reference LT, and thus a distance 
between the reference points 34 and 36 can be represented by 
the same reference LT, because the respective line segments 
=== between the reference points 32 and 34 and between the 
S reference points 34 and 36 have the same length, as mentioned 
ft above. Accordingly, as shown in Fig. 5, the reference point 
y 32 is represented by the coordinates P gl (-LT, 0, 0), the 

reference point 34 is represented by the origin coordinates 
3 P g2 (0, 0, 0), and the reference point 36 is represented by the 
5; coordinates * s3 (0, 0, LT) . 

ft The back principal point M (Ml) is determined with 

respect to the first scene coordinate system (Xg-Yg-Zg) . To 
this end, a two-dimensional X p -Y p coordinate system is defined 
on the image plane F or first picture IMl, as shown in Figs. 5 
and 6, and a three-dimensional X c -Y c -Z c coordinate system is 

20 defined on the camera 50, as shown in Fig. 5. 

As best shown in Fig. 6, the origin of the X p -Y p 
coordinate system coincides with the center C of the image 
plane F or first picture IMl, and the X p - and Y p -axes extend 
horizontally and vertically, respectively. The reference 

25 points 32, 34 and 36 photographed on the first picture IMl are 
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represented by two-dimensional coordinates p^Cxp^, yp x ) t 
P 2 (*P 2 ' *P2> « d P3^3' *P3>' respectively. Note, the X p -Y p 
coordinate system is referred to as a picture coordinate 
system hereinafter. 
5 Also, as shown in Fig, 5, the origin of the X C ~Y C -Z C 

coordinate system coincides with the back principal point M 
(Ml), the Z c -axis coincides with the optical axis 01, and the 
ri respective X c - and Y c -axes are in parallel to the the x p - and 
S Y p -axes of the two-dimensional coordinate system X p -Y p . The 
fjlj origin of the X C -Y C ~Z C coordinate system or back principal 
S point M is represented by three-dimensional coordinates M(AX, 
m AY, AZ) which are based on the first scene coordinate system 
(X s -Y s -Z s ) . An orientation of the Z c -axis or optical axis 01 
is represented by three-dimensional angular coordinates (a , |3, 
|J y) which are defined with respect to the first scene 

coordinate system <X S ~Y S -Z S ) . Namely, the Z c ~axis or optical 
axis Ol defines angles of a, 3 and y with the X s ~, Y $ - and Z g - 
axes of the first scene coordinate system, respectively- 

When two-dimensional coordinates p^xp^ yp L ) (i = 1, 
20 2, 3), representing the coordinates p^xp^ yp x ) / P2< X P2' 3^*2* 
and p 3 (xp 3 , yp 3 ) based on the picture coordinate system (X p -Y p ) 
are expressed by three-dimensional coordinates ^(^i^ *eyi' 
P ozi ) based on the camera coordinate system (X c -Y c -Z c ) , the X- 
coordinate xp i and the Y-coordingate yp i are represented by the 
25 following formulas (1) and (2), respectively: 

-27- 



from msm 



2000$ 6fi29B(*)17:32/Hl7:27/iaSH801 158657 P 29 



=15 



20 



25 



Heroin: V = l y 2 or 3, and is the focal distance* 

On the other hand, the three-dimensional coordinates 
P ci (P cxi , P cyi' ^czi^ based on the camera coordinate system (X c ~ 
Y C -2 C ) is expressed by three-dimensional coordinates ^ S i^ ax i' 



^syi' *szi* based on the scene coordinate system (X S ~Y S -Z g ) as 



follows : 



*ci - *<».i " A) 



(3) 



CO80CO& y cosasiny+slnaslnficQs y sinas±ny^cosasxnj3cas y 
- co^iny cos^cos y- sina r sin#sin y sxxLaaosy+co&otsxnfBslxi y 
$ln/3 ~&±nacos0 cosctcosfi 



A ~ 



AY 
AZ 



Herein: "R" is a rotational xaatrix of the angles a, [3, y, and 
"A" is a vector representing a movement distance the origin of 
the camera coordinate system (X C ~Y C ~Z C ) from the origin of the 
scene coordinate system (X 3 -Y s -Z s ) ♦ 

In short, the three-dimensional coordinates M(AX, AY, 
AZ) and the thxee-dimensional angular coordinates (a, $, y) 
are calculated by the formulas (1) , (2) and (3) , whereby the 
back principal point M or first photographing position Ml is 
spatially determined with respect to the scene coordinate 
system CK S -Y S -Z S ) . 
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In reality, each of the reference points 32, 34 and 36 
is represented as a small white circle , which is formed at a 
center of a circular black plate element attached to an L- 
shaped member. By suitably processing a frame of image data 
5 read from the memory card 13, the small white circles, 

representing the reference points 32, 34 and 36, are extracted 
from the frame of image data, whereby coordinates of each 
p reference point (32, 34, 36) are determined. Namely, in the 
ff\ example shown in Figs . 4 to 6 , the determination of the 
§f) coordinates P sl (-LT, 0, 0) , P s2 <°/ Q r °) an <* p s3* 0 ' °' LT > are 
S automatically executed by the CPU 14 on the basis of the frame 
^ of image data obtained at the first photographing position Ml . 
S The remaining photographing positions M2 to Ml 8 are 

2f spatially determined in substantially the same manner as 
15 mentioned above. Of course, the spatial determination of the 
photographing positions M2 to M6 are executed with respect the 
first scene coordinate system (X g -Y g -Z g ) defined on the target 
TG located at the first target position RFl, the spatial 
determination of the photographing positions M7 to M10 are 
20 performed with respect to a second scene coordinate system 

defined on the target TG located at the second target position 
RP2, and the spatial determination of the photographing 
positions Mil to M18 are executed with respect to a third 
scene coordinate system defined on the target TG located at 
25 the third target position RP3 . 
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Not©, the above-mentioned spatial determination of the 
photographing positions Ml to Ml 8 is automatically executed 
when the eighteen frames of image data are read from the 
memory-card 13 . 

5 When the survey map of the roadway is produced by 

successively connecting the nine survey map sections to each 
other, the spatial determination of all the eighteen 
photographing positions Ml to M18 must be united with respect 

ffi to any one of the first, second and third scene coordinate 

W systems. For example , when the first scene coordinate system 

5 (X s -Y s -Z s ) is selected for the determination of all the 

photographing positions Ml to M18, the second and third scene 

r: coordinate systems must be transformed into the first 
coordinate syatem (X s -Y s ~z s ) . 

W Referring to Fig. 7, the transformation of the second 

scene coordinate system into the first scene coordinate system 
(X s -Y s ~Z g ) is conceptually shown. In this drawing, the three 
axes of the second scene coordinate system are indicated by 
references X g ; , Y^' and 2 g ', and the movement of the target TG 

20 from the first target position RP1 to the second target 

position RP2 is represented by two-dimensional coordinates 
* X dp' z dp) based on first scene coordinate system (X S ~Y S ~ 

2 g ) . Also, an angle of £ indicates a relative rotational angle 
of the target TG between the first and second target positions 

25 RP1 and RP2, In Fig, 7, each of references 02, 07 and 08 
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indicates an orientation of the optical axis of the camera 50 
located at the corresponding photographing position (M2, M7, 
M8) . 

The two-dimensional coordinates (X dp , Z^) and the 
5 rotational angle o£ £ are determined by calculating the three- 
dimensional coordinates of the connection points RC1 and RC2 
of the cone-shaped ma.xX&xs MKl and MK2 with respect to the 
^ first and second scene coordinate systems (X S ~X S -Z S , X^'-Y^'- 

Z s ') , respectively, 
[;0 After the determination of the two-dimensional 

coordinates OC^, Z^) and the rotational angle of \ 9 the 
transformation of the second scene coordinate system 
Z s ') into the first scene coordinate system (Xg"Y g -Z g ) is 
performed on the basis of the following formula <4) : 



as 
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20 Of course , the transformation of the third scene 

coordinate system into the first scene coordinate system (X g - 
Yg-Zg) is performed in substantially the same manner as 
mentioned above. 

Figure S shows, by way of example, a connection-mode 

25 scene, displayed on the monitor 10 for executing a processing 
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for successively connecting the nine pairs of pictures to each 
other. Note, the connection -mode scene is selected from an 
initial menu scene {not shown) displayed on the monitor 10 
after the image processing computer system is powered ON. As 
5 shown in Fig, 8, the connection-mode scene includes a picture- 
display area GDA and an editing-display area C£A~ 

As shown in Fig. 8, a part of the pictures included in 
the first group are displayed on the picture-display area GDA. 
m As mentioned above, the first group of pictures, featuring the 
Jp target TG located at the first target position RP1, is 
^ composed of the first pair of pictures (Ml, M2) , the second 

pair of pictures (M3, M4) and the third pair of pictures <M5, 
^ M6) f and only one picture in each pair is representatively 
2f displayed on the picture -display area GDA, In the example 
Jf5 shown in Fig, 8, the displayed pictures IMl, IM3 and IMS are 
obtained at the first, third and fifth photographing positions 
Ml, M3 and M5. Namely, the pictures IM1, IM3 and 1MB are 
disposed in the photographing order. The display of the 
pictures 1M1, IM3 and IMS on the picture-display area GDA is 
20 performed at a reduced size, and the reduced sized pictures 
IM1, IM3 and 1MB are referred to as objects OBI, OB2 and OB3, 
respectively, hereinafter. 

Note, of course, image data for the objects OBI, OB2 
and OB3 are produced on the basis of the first, third and 
25 fifth frames of image data read from the memory card 13, and 
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are sheared in the display memory 20 . 

As shown in Fig. 8, an advancing button GGA and a 
returning button GGR are displayed adjacent to the top of the 
picture-display area GDA- When the advancing button GGA is 
5 operated by clicking on it with the mouse , the scene of the 
picture-display area GDA is changed such that a part of the 
pictures included in the second group are displayed thereon in 

□ substantially the same manner as the part of the pictures 

included in the first group. When the advancing button GGA is 

JD further operated by clicking on it with the mouse, a part of 

]Zj the pictures included in the third group are displayed on the 
" picture -display area GDA in substantially the same manner as 

S the part of the pictures included in the first group. On the 
other hand, whenever the returning button GGR is operated by 

pfcB clicking on it with the mouse, the scenes of the picture- 
display area GDA are successively returned. In short, by 
suitably operating the buttons GGA and GGR, it is possible to 
selectively display any one of the above-mentioned three parts 
of the pictures on the picture-display area GDA. 

20 The editing-display area CEA is used as a visual 

editing area for editing the pictures or objects. As shown in 
Fig- 8, mode-setting buttons ARM, MVM and DIM are displayed 
adjacent to the top of the editing-display area CEA. 

The mode setting button ARM serves as an object- 

25 transferring/connecting-mode button ♦ When the button ARM is 
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operated by clicking on it with the mouse, the button ABM is 
displayed an object- transferring/connecting mode is set. In 
reality, the operated button ARM is displayed as if being 
depressed, whereby it is possible to visually confirm the 
5 setting of the object- transferring/ connecting mode. In this 
mode, the pictures or objects are transferred from the 
picture-display area GDA to the editing-display area CEA, and 
^ are visually connected to each other, as mentioned in detail 
~ hereinafter. Note, whenever the connection-mode scene (Fig, 
|$ 8) is selected from the initial menu scene of the monitor 10, 

the object-transferring/connecting mode is forcibly set. 
m The mode setting button MVM serves as an object- 

^ arranging-mode button. When the button MVM is operated by 
jjf clicking on it with the mouse, an object-arranging mode is 
fl set. The operated button MVM is also displayed as if being 
depressed, whereby the setting of the object- arranging mode 
can be visually confirmed. In this mode, the pictures or 
objects can be optionally arranged on the editing-display area 
CEA, as mentioned in detail hereinafter. 
20 The mode setting button DLM serves as an object- 

deleting-mode button, "When the button DLM is operated by 
clicking on it with the mouse, an object-deleting mode is set. 
Similarly, the operated button DLM is displayed as if being 
depressed, whereby the setting of the object-deleting mode can 
25 be visually confirmed. In this mode, the pictures or objects 
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can be deleted from the editing- display area CEA, and the 
deleted objects can be again displayed on the picture-display 
area GDA. 

Not©, in Fig- 8, the operated button ARM is hatched so 
5 as to be distinguished from the non-operated buttons MVM and 
DLM. 

In the object-transferring/connecting mode (ABM) , for 
example, when the object OBI is indicated by clicking on it 
m with the mouse, the object OBI is encompassed by a single-dot- 
Jj) line frame, as shown in Fig. 8, whereby the object OBI is 
S visually distinguished from the remaining objects OB2 and OB3. 
"T Then, when the pointer (not shown) is moved in the editing- 
JS display area CEA by manipulating the mouse, a broken-line 
S frame GM is displayed on the editing-display area CEA such 
;£5 that the pointer is surrounded by the broken-line frame GM* 
When the pointer is moved within the editing- display area CEA 
by manipulating the mouse, the pointer takes with it the 
broken-line frame GM. Thus, the broken-line frame GM can be 
positioned at a given location by the pointer. After the 
20 positioning of the broken-line frame QM, when a clicking 

operation is performed with the mouse, all the objects OBI, 
OB2 and OB3 are once transferred from the picture-display area 
GDA to the editing-display area CEA, as shown in Fig. 9. 

The transferred objects OBI, OB2 and OB3 are connected 
25 to each other in the photographing order by connecting- strips 
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CNS displayed on the editing-display area CEA, whereby it is 
possible to visually recognize the relationship between the 
objects OBI, OB2 and OB3 . Each of the displayed connecting- 
strips CNS behaves just like a rubber strip connected between 
5 the centers of the two adjacent objects (OBI and OB2 or OB2 
and OB3) at the back faces thereof. Namely, for example, if 
the object OBI is moved apart from the remaining objects OB2 
and OB3 in the object- arranging mode, the connecting- strip CNS 
is displayed as being extended between the centers of the 
j§ objects OBI and OB2. 

O In the scene of Fig. 9, as mentioned above, when the 

object-deleting button DIM is operated by clicking on it with 
O the mouse, the object-deleting mode is selected. In this 
\M mode, when one of the objects OBI, OB2 and OB3 is indicated by 
& clicking on it with the mouse, all the objects OBI, OB2 and 
OB3 are deleted from the editing-display area CEA, and are 
then displayed on the picture-display area GDA, Namely, the 
soene of Fig . 9 is returned to the scene as shown in Fig . 8 . 
As shown in Fig. 9, as soon as the transfer of the 
20 objects OBI, OB2 and OB3 from the picture-display area GDA to 
the editing-display area CEA is performed, the part of the 
pictures included in the second group is displayed on the 
picture -display area GDA, regardless of the operation of the 
advancing button GGA. Namely, the objects OB4 and OB5, which 
25 correspond to the pictures IM7 and IM9 obtained at the 
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photographing positions M7 and M9, respectively, are displayed 
on the picture-display area GDA» Of course, image data for 
the objects OB4 and OB5 are produced on the basis of the 
seventh and ninth frames of image data read from the memory 
5 card 13, and are stored in the display memory 20* 

The objects OB4 and OB5 (IM7 and IM9) are based on the 
target TG being located at the second target position RP2 . 
Thus, before the objects OB4 and OB5 can be connected to the 
m objects OBI, OB2 OB3 based on the target TG being located at 
IS the first target position RPl, it is necessary to execute a 
i-i processing for transforming the second scene coordinate system 
7 ( x s'~ Y s ,w Z g ') into the first scene coordinate system (X S "Y S -Z g ) . 

For the transformation of the second scene coordinate 
S system into the first scene coordinate system, one of the 
If objects OB4 and OB5 and one of the objects OBI, OB2 and OB3 to 
be connected to each other are selected. For example, as 
shown in Fig. 10, the objects OB4 and OB3 to be connected to 
each other are selected, and the selection of each object 
(OB4, OB3) is performed by clicking on it with the mouse, 
20 whereby each of the selected objects OB4 and OB3 are 

encompassed by a single-dot-line frame, as shown in Fig. 10* 
Then, when the pointer is moved in the editing-display area 
CEA by manipulating the mouse, a broken-line frame GM appears 
on the editing-display area CEA (Fig. 10) , with the pointer 
25 indicating the center of the broken-line frame GM. After the 
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broken-line frame GM is positioned at a given location by the 
pointer, when a clicking operation is performed with the 
mouse, the scene (Fig. 10) of the monitor 10 is changed into a 
scene as shown in Fig. 11. 
5 On the scene of Fig. 11, the third pair of pictures IMS 

and IM6 and the fourth pair of pictures IM7 and IM8 are 
displayed- Of course , the third pair of pictures IMS and IM6 
are obtained at the photographing positions M5 and M6 , and are 

Si based on the target TG being located at the first target 

jBj) position RPl, and the fourth pair of pictures IM7 and IMS are 
obtained at the photographing positions M7 and M8, and are 

m based on the target TG being located at the second target 

if position RP2 . 

^ As shown in Fig. 11, the respective connection points 

ft RCl and RC2 of the cone-shaped markers MK1 and MK2 (Fig. 1) 
are displayed as image points RC15 and RC25 on the picture 
IMS, and are displayed as image points RCl 6 and RC26 on the 
picture IM6 ♦ Also, the respective connection points RCl and 
RC2 of the cone-shaped markers MK1 and MK2 are displayed as 

20 image points RC17 and RC27 on the picture IM7, and are 

displayed as image points RCl 8 and RC28 on the picture IM8* 

Also, on the scene of the monitor 10 shown in Fig. 11, 
a first designation button KB1, a second designation button 
KB2 , a completion button OFN and a cancel button OCS are 

25 displayed. 
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When the first: designation button KBl is operated by 
clicking on it with the mouse, a first designation mode is 
selected to designate the image points RC15, RC16, RC17 and 
RC18- In the first designation mode, when the image points 
5 RC15 and RC16 are consecutively designated by clicking on them 
with the mouse , three-dimensional coordinates of the 
connection point RC1 are calculated with respect to the first 
scene coordinate system <X S -Y g -Z s ) . Also, when the image 
points RC17 and RC18 are consecutively designated by clicking 
y> on them with the mouse, three-dimensional coordinates of the 
y connection point RC1 are calculated with respect to the second 

scone coordinate system (X^'-Yg'-Zg 1 ) . 
2 When the second designation button KB2 is operated by 

2f clicking on it with the mouse, a second designation mode is 
§J5 selected to designate the image points RC25, RC26, RC27 and 
RC28. In the second designation mode, when the image points 
RC25 and RC26 are consecutively designated by clicking on them 
with the mouse, three-dimensional coordinates of the 
connection point RC2 are calculated with respect to the first 
20 scene coordinate system (Xg-Yg-Zg) ♦ Also, when the image 

points RC27 and RC28 are consecutively designated by clicking 
on thfr*" with the mouse, three-dimensional coordinates of the 
connection point RC2 are calculated with respect to the second 
scene coordinate system (Xg'-Yg'-Zg') . 
25 Thus, it is possible to determine not only a relative 
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movement distance of the target TG from the first target 
position RP1 to the second target position RP2 but: also a 
relative rotational angle of the second scene coordinate 
system (Xg'-Yg'-Zg*) with respect to the first scene coordinate 
5 system (X S ~Y S -Z 5 ) . Of course/ the determined movement distance 
and the determined rotational angle represent the coordinates 
(X^, the angle of respectively, as explained with 

& reference to Pig. 7, In short, by the designation of the 
S image points (RC15 , RC16, RC17 and RC18; and RC25, RC26, RC27 
l£0 and RC28) , the transformation of the second scene coordinate 
S system (Xg'-Yg'-Zg') into the first scene coordinate system (X s ~ 

Y S »Z S ) is performed on the basis of the above-mentioned formula 
y (4) , whereby the photographing positions M7 , M8, M9 and M10 
[^1 are expressed with respect to the first scene coordinate 
:|5 system (X S ~Y S -Z S ) , resulting in connection between the first 
group of pictures (XMCL to IM6) and the second group of 
pictures (IM7 to IM10) . 

After the designation of the image points (RC15, RC16, 
RC17 and RC18; and RC25, RC26, RC27 and RC28) , the completion 
20 button OFN is operated by clicking on it with the mouse, the 
scene (Fig. 11) of the monitor 10 is changed into a scene as 
shown in Fig. 12. As is shown in this drawing, the objects 
OB4 and OB5 are transferred from the picture-display area GDA 
to the editing-display area CEA, and the objects OB4 and OB5 
25 are successively connected to the object OB3, included in the 
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first group, by connecting-strips CNS. 

In the* scene of Fig, 11, when it is perceived that the 

designation of a pair of image points (RC15 and RC16; RC17 and 

RC18; RC25 and RC26; RC27 and RC28) is erroneously performed, 
5 the designation concerned is canceled by operating the cancel 

button OCS by clicking on it with the mouse. Thereafter, the 

designation can be tried again. 
^ &s shown in Fig. 12 , as soon as the transfer of the 

objects OB4 and OB5 from the picture-display area GDA to the 
30 editing-display area CEA is performed/ the part of the 
5; pictures included in the third group is displayed on the 

picture-display area GDA, regardless of the operation of the 
L;: advancing button GGA. Namely, the objects OB6, Ob7, OB8 and 
^ OB9, which correspond to the pictures 1M11, IM13, and 
|§5 IK17 obtained at the photographing positions Mil, M 13, M15 

and M17, respectively, are displayed on the picture -display 

area GDA. Of course, image data for the objects OB6, Ob?, OB8 

and OB9 are produced on the basis of the eleventh, thirteenth, 

fifteenth and seventeenth frames of image data read from the 
20 memory card 13 , and are stored in the display memory 20, 

Note, in Figs* 12 and 13, each of the objects OB6, OB7, 

OB8 and OB 9 is shown as a blank frame for the sake of 

convenience « 

Similar to the above-mentioned cases, the objects OB6, 
25 Ob7, OB8 and OB9 can be transferred from the picture-display 
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area GDA to the editing-display area CEA, and can be connected 
to the second group of the objects in substantially the same 
manner as explained above with respect to the objects OB4 and 
OB5 included in the second group* 
5 For example, in the scene of the Fig, 12, when the 

object- arranging mode is selected by operating the object- 
arranging-mode button MVM by clicking on it with the mouse , 
S the objects OBI, OB2, OB3, OB4 and OB5, connected to each 
LI other by the connecting-strips CNS, can be optionally 
10 rearranged on the editing-display area CEA, as shown in Fig, 
Q 13 in which the operated button MVM is hatched to indicate the 
setting of the object-arranging mode. 

In particular , when one of the objects OBI, OB2, OB3, 
p OB4 and OB5 is indicated by clicking on it with the mouse, the 
jj> indicated object is encompassed by a single-dot-line frame, 
just like the object OB4 shown in Fig. 10. Then, when the 
pointer (not shown) is out of the indicated object, a broken- 
line frame (GM) , as shown in Fig* 8 or 10, is displayed on the 
editing-display area CEA such that the pointer is surrounded 
20 by the broken-line frame (GM) . When the pointer is moved 

within the editing-display area CEA by manipulating the mouse, 
the pointer takes with it the broken-line frame (GM) . Thus, 
the broken-line frame (GM) can be positioned at a given 
location by the pointer. After the positioning of the broken- 
25 line frame (GM) , when a clicking operation is performed with 
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the mouse, the indicated object is moved from an original 
position shown in Fig. 12 to a new position shown in Fig. 13. 
In this way, the objects OBI, 0B2, 0B3, OB4 and OB5 shown in 
Pig. 12 can be rearranged as shown in Pig. 13. 
5 In short, the objects can be optionally arranged on the 

editing-display area CEA in accordance with an operator's taste 
or choice. For example, the rearrangement of the objects are 
P performed such that the operator or photographer can be easily 
5 reminded of the photographing scenes, resulting in 
JjjQ facilitation of the production of the survey map. 
g Note, it is apparent from Fig. 13 that each of the 

*fc displayed connecting-strips CNS behave just like a rubber 
« strip connected between the centers of the two adjacent 
W objects at the back faces thereof when each of the objects is 
□5 moved. 

Also, note, of course, in the scene of Fig. 9, when the 
object-arranging mode is set, it is possible to rearrange the 
objects OBI, OB2 and OB 3. 

In the scene of Pig. 12 or 13, when one of the objects 
20 OBI, OB2 and OB3 is indicated by clicking on it with the mouse 
in the object- dele ting mode (DLM) , all the objects OBI, 0B2 
and OB3 are deleted from the editing-display area, and are 
then returned to the picture-display area GDA. Similarly, 
When one of the objects OB4 and OB5 is indicated by clicking 
25 on it with the mouse, both the objects OB4 and OB5 are deleted 
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from the editing-display area CEA, and are then returned to 
the picture-display area GDA. 

The first group of objects OBI, OB2 and OB3, the second 
group of objects OB4 and OB5, and the third objects OB6, OB7 , 
5 OB8 and OB 9 are displayed on only one of the picture-display 
area GDA and the editing-displayed area CEA, Namely, each of 
the first/ second and third groups cannot be simultaneously 
fi displayed on both the picture-display area GDA and the 
ff\ editing-displayed area CEA. 

£0 For this end, a GDA-list memory area and a CEA-list 

^ memory area are defined in the working memory 19* Respective 
object-numbers rt l" to "9", which represent the objects OBl to 
OB9 are initially stored in the GDA-list memory area, whereby 
:if the first, second and third groups of objects (OBI, OB2 and 
*§> OB3; 0B4 and OBS; and OB6, OB7, OB8 and OB9) are enabled to be 
selectively displayed on the picture-display area GDA, as 
explained with reference to Fig, 8. On the other hand, the 
CEA-list memory area are initially cleared, whereby the first, 
second and third groups of objects cannot be displayed on the 
20 editing-display area CEA. 

For example, when the first group of objects OBI, OB2 
and OB3 are transferred from the picture-display area GDA to 
the editing-display area CEA, the object-numbers u l n , tt 2* and "3" 
are cleared from the GDA-list memory area, and the cleared 
25 object-numbers a l ff , u 2" and "3" are added to the CEA-list memory 
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area, whereby the first group of objects OBI , OB2 and OB3 are 
enabled to be displayed on the editing-display area CEA, but 
cannot be displayed on the picture-display area GDA, On the 
contrary, when the first group of objects OBI, OB2 and 0B3 are 
5 returned from the editing-display area CEA to the picture- 
display area GDA, the object-numbers *1\ "2" and u 3 n are cleared 
from the CEA- list memory area, and the cleared object-numbers 
O "1", *2 n and "3" are added to the GDA-list memory area. Of 
fp course, this is true for the second and third groups of 
CflO objects (0B4 and OB5; and OB6, OB7, OB8 and OB9) . 
p The scenes of the monitor 10 , shown in Pigs. 8, 9, 10, 

s " 12 and 13, include a setting-menu-display area MSA which is 
m associated with a setting-alteration button DST and a setting- 
5 fixing button DI*M displayed thereon. When the button DST is 
pi5 operated by clicking on it with the mouse, various setting- 
menus are displayed on the setting-menu-display area MSA. 
Among the setting-menus, for example, there are a size- 
altering menu for altering a size of an object <OBl to OB9) or 
picture (IM1 to IM18) to be displayed, and a connecting- s trip - 
20 altering menu for altering a width, a color or the like of a 
connecting- strip (CNS) to be displayed. Each of the setting- 
menus has various setting-items, and an alteration of a 
setting is performed by indicating a corresponding setting- 
item by clicking on it with the mouse. After the alteration 
25 of the setting is completed, when the setting-fixing button 
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DM4 is opera-bed by clicking on it: with the mouse, the 
alteration of the setting is fixed, and the setting-menus 
disappear from the setting-menu-display area MSA. 

Further , on the scenes shown in Figs. 8, 9, 10 , 12 and 
5 13 , a completion button CIB and a cancel button CSB are 

displayed. After the objects (OBl to OB9) are successively 
connected -to each other, when^t&e completion button CIB is 
operated by clicking on it with the mouse, the connection data 
^ between the objects (OBl to OB9) are stored in a suitable 
GO memory medium (not shown) , such as a hard disc, provided in 
Q the image processing computer system , and the connection-mode 
m scene of the monitor 10 is returned to the initial menu scene. 
O Also, whenever the cancel button CSB is operated by clicking 

on it with the mouse, a processing concerned for connecting 
rt5 objects to each other is canceled. 

Figure 14 shows a flowchart for an object-connecting 
routine, which is executed when the connection-mode scene is 
selected from the initial menu scene of the monitor 10, as 
shown in Fig, 8, Note, when an execution of the object- 
20 connecting routine is started, the above-mentioned spatial 
determination of the photographing positions Ml to MIS is 
already completed. { 

At step Sll, the connection-mode scene is displayed on 
the monitor 10 in a blank manner such that no objects are 
25 displayed on the picture-display area GDA and the editing- 
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display area CEA, Then, at step S12, a variable "MODE" is made 
to be u l ff , whereby the object- transferring/connecting mode is 
set on the connection-mode scene of the monitor 10 , because 
the object-transferring/connecting mode is forcibly set when 
5 the connection-mode scene is selected from the initial menu 
scene of the monitor 10, as mentioned above* Namely, when the 
variable 'MODE" is "1", it indicates the setting of the object- 
transferring/ connecting mode on the connection -mode scene, 
ffl Note, when the object-arranging-mode button MVM is 

ID operated by clicking on it with the mouse , the object- 
ed arranging mode is set, whereby the variable "MODE" is made to 
CO be "2", and, when the object-dele ting-mode button DLM is 
O operated by clicking on it with the mouse, the object-deleting 

mode is set, whereby the variable "MODE" is made to be "3\ 
U At step S13, all the object-numbers "1" to U 9 H , which 

represent the objects OBI to OB9, respectively, are added to 
the GDA-list memory area defined in the working memory 19, and 
the CEA-list memory area defined in the working memory 19 is 
cleared* 

20 At *^*P S14, variables M ADDNUM" and "EDITNUM? are reset 

to be "0". The variable "ADDNUM* is used to represent whether 
one of the objects, displayed on the picture-display area GDA, 
is indicated by clicking on it with the mouse. When the 
indication of an object on the picture-display area GDA is 

25 confirmed, the variable "ADDNUM" is made to be an object-number 
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corresponding to the indicated object. For example; as shown 
in Fig, 8, when the object OBI is indicated by clicking on it 
with the mouse, the variable "ADDNUM* is made to be u l ,p . The 
variable "EDITNTOT is used to represent whether one of the 
5 objects, displayed on the editing-display area CEA, is 
indicated by clicking on it with the mouse. When the 
indication of an object on the editing-display area CEA is 
confirmed, the variable "EDiraraT is made to be an object- 
number corresponding to the indicated object. For example , as 
£|0 shown in Fig. 10, the object OB3 is indicated by clicking on 

□ it with the mouse, the variable "EDITNUM** is made to be "3". 
;Q At step S15, the first group of objects OBI, OB2 and 

□ OB3 is displayed on the picture-display area GDA in accordance 
;,y with the object-numbers listed on the GDA- list memory area* 

Hi 5 Thus, the scene of the monitor 10 corresponds to one as shown 
in Fig- 8 except that the broken-line frame GM is displayed on 
the editing-display area CEA. 

At step S16, it is monitored whether the pointer is 
entered into the editing-display area CEA by manipulating the 
20 mouse. When the pointer is in the editing- display area CEA, 
the control proceeds to step S100, in which a subroutine SBR1 
is executed. The subroutine SBR1 is to manage a display of 
the broken -line frame GM on the editing-display area CEA. 
Note, the subroutine SBRl is explained in detail with 
25 reference to Fig. 15 hereinafter. 
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At step S16, when the pointer is not in the editing- 
display area CEA, the control proceeds to step S17 , in which 
it is monitored whether a clicking operation is performed with 
the mouse. When the clicking operation is not confirmed, the 
5 control returns to step SI 6. 

At step S17, when the clicking operation is confirmed, 
the control proceeds to step SIS, in which it is determined 
whether a predetermined area is indicated by the pointex 
fl during the performance of the clicking operation. 
QO At step S18, when the predetermined area, indicated by 

O the pointer, is either the advancing button GGA or the 
rn returning button GGR, the control proceeds to step S200, in 
O which a subroutine SBR2 is executed. Note, the subroutine 
hi SBR2 is explained in detail with reference to Fig. 16 
qL 5 hereinafter - 

At step S18, when the predetermined area, indicated by 
the pointer , is the object-transferring/connecting-mode button 
ARM, the control proceeds to step S300, in which a subroutine 
SBR3 is executed. Note, the subroutine SBR3 is explained in 
20 detail with reference to Fig. 17 hereinafter* 

At step S18, when the predetermined area, indicated by 
the pointer, is the objeet-arranging-mode button MVM, the 
control proceeds to step S400, in which a subroutine SBR4 is 
executed. Note, the subroutine SBR4 is explained in detail 
25 with reference to Fig. 18 hereinafter. 
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At step S18, when the predetermined area, indicated by 
the pointer, is the object-dele ting-mode button dim, the 
control proceeds to step S500, in which a subroutine SBR5 is 
executed. Note, the subroutine SBR5 is explained in detail 
5 with reference to Fig. 19 hereinafter. 

At step S18, when the predetermined area, indicated by 
the pointer, is the picture-display area GDA, the control 
Proceeds to step S600, in which a subroutine SBR6 is executed. 
Note, the subroutine SBR6 is explained in detail with 
CIO reference to Fig. 20 hereinafter, 

y At step SI 8, when the predetermined area, indicated by 

the pointer, is the editing-display area cea, the control 

O proceeds to step S700, in which a subroutine SBR7 is executed. 

y Note, the subroutine SBR7 is explained in detail with 

£j5 reference to Fig. 21 hereinafter . 

At step S18, when the predetermined area, indicated by 
the pointer, is the completion button CIB, the control 
proceeds to step S800, in which a subroutine SBR8 is executed- 
Note, the subroutine SBR8 is explained in detail with 

20 reference to Fig. 22 hereinafter. 

Note, at step S18, when it is not confirmed that any 
one of the predetermined areas is indicated by the pointer 
during the performance of the clicking operation, the control 
returns to step SI 6. 

25 Figure 15 shows a flowchart for the subroutine SBR1 
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executed at step SlOO of the object-connecting routine shown 
in Fig, 14. Of course, the execution of the subroutine SBR1 
is started when the clicking operation is performed provided 
that the pointer is in the editing-display area CEA. 
5 At step S101, it is determined whether a broken-line 

frame GM is displayed on the editing- display area CEA * When 
the broken-line frame GM is not displayed on the editing- 
display area CEA, the subroutine SBRl once ends. 

Note, as mentioned above, the broken-line frame GM is 
3.0 not displayed on the editing-display area CEA until an object 
is indicated by clicking on it with the mouse in either the 
picture-display area GDA or t^ia editing-display area CEA, and 
an initial display of the broken-line frame GM is explained 
hereinafter . 

^15 At step S101, when a broken-line frame GM is displayed 

on the editing-display area C&A, the control proceeds to step 
S1Q2, in which the broken-line frame GM is eliminated from the 
editing-display area CEA, Then, at step SI 03, a new broken- 
line frame GM is displayed on the editing-display area CEA. 

20 The routine comprising steps S102 and S103 is repeated as long 
as the pointer is in the editing-display area CEA, whereby it 
is observed that the broken- line frame GM is moved together 
with the pointer in the editings-display area CEA* 

Figure 16 shows a flowchart fox the subroutine SBR2 

25 executed at step S200 of the object-connecting routine shown 
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in Fig. 14. Of course, the execution of the subroutine SBR2 
is started when the clicking operation is performed provided 
that either the advancing button GGA or the returning button 
GGR is indicated by the pointer* 
5 At step S201, it is determined whether the advancing 

button GGA is operated by clicking on it with the mouse, When 
the operation of the advancing button GGA is confirmed, the 
control proceeds to step S202, in which a next group of 
objects is displayed on the picture-display area GDA. Then, 

J|0 at step S203, both the variables "ADD1TOM* and "EDITNUM" are 
reset to be "0". Note, when the advancing button GGA is 

CB operated while the last or third group of objects OB6, OB7 , 

U OB8 and OB9 is displayed on the picture-display area GDA, the 

W first group of objects OBI, OB2 and OB3 is displayed on the 

CB5 area GDA as the next group of objects. 

At step S201, when the advancing button GGA is not 
operated, i.e. when the returning button GGR is operated, the 
control proceeds to step S204, in which a preceding group of 
objects is displayed on the picture-display area GDA. Then, 

20 at step S203, both the variables "ADDNUM" and "EDITNUM" are 
reset to be "0". Note, when the returning button GGR is 
operated while the first group of objects OBI, OB2 and OB3 is 
displayed on the picture-display area GDA, the third group of 
objects OB6, OB7, OB8 and OB9 is displayed on the area GDA as 

25 the preceding group of objects. 
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Figure 17 shows a flowchart for the subroutine SBR3 
executed at step S300 of the object-connecting routine shown 
in Fig. 14. Of course, the execution of the subroutine SBR3 
is started when the clicking operation is performed provided 
5 that the pointer is on the object- transfer ring/ connection 
button ABM- 

At step S301, the variable "MODE* is made to be "1", 
O and, at step S302, both the variables "ADDNUM" and "EDITNUM" are 
m reset to be tt 0*\ Then, at step S303, only the object- 
SlO transferring/ connecting-mode button ARM is displayed as if 
R being depressed, thereby indicating the setting of the object- 
or transferring/connecting mode. 

5; Figure 18 shows a flowchart for the subroutine SBR4 

executed at step S400 of the object-connecting routine shown 

3.S in Fig- 14. Of course, the execution of the subroutine SBR4 
is started when the clicking operation is performed provided 
that the object-arranging button MVM is indicated by the 
pointer « 

At step S401, the variable "MODE" is made to be "2" , 
20 and, at step S402, both the variables "ADDNUM" and "EDITNUM" are 
reset to be "0". Then, at step S403, only the object- 
arranging-mode button MVM is displayed as if being depressed, 
thereby indicating the setting of the object- arranging mode. 

Figure 19 shows a flowchart for the subroutine SBR5 
25 executed at step S500 of the object-connecting routine shown 
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in Pig* 14. Of course, the execution o£ the subroutine SBR5 
is started when the clicking operation is performed provided 
that the object-deleting button DLM is indicated by the 
pointer . 

5 At step S501, the variable "MODE" is made to be *3 ,r , 

and, at step S502, both the variables "ADDNUM" and "EDXTNUM" are 
reset to be "0". Then, at step S503, only the object-deleting- 
mode button DLM is displayed as if being depressed, thereby 
S[ indicating the setting of the object-deleting mode. 
3K) Figure 20 shows a flowchart for the subroutine SBR6 

™ executed at step S600 of the object-connecting routine shown 
^ in Pig, 14. Of course , the execution of the subroutine SBR6 
j^f is started when the clicking operation is performed provided 
^ that the pointer is in the picture-display area GDA. 
05 At step S601, it is determined whether the variable 

TMODE* is u l n , i.e. whether the object-transferring/connecting 
mode is selected- If MODE * 1, the subroutine SBR6 once ends. 
Namely , the clicking operation is ignored when the okjoct- 
transf erring/connecting mode is not selected. 
20 At step S601, when it is confirmed that the object- 

transferring/connecting mode is selected (MODE = 1) , the 
control proceeds to step S602, in which it is determined 
whether the clicking operation is performed provided that any 
one of the objects displayed on the picture-display area GDA 
25 is indicated by the pointer- If the pointer is out of the 
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object displayed on the area GDA, the subroutine SBR6 once 
ends. Namely, the clicking operation is ignored when the 
pointax is out of the object displayed on the area GDA. 

At step S602, when it is confirmed that the clicking 
5 operation is performed provided that the object is indicated 
by the pointer, the control proceeds to step S603, in which 
the variable "ADDNUM" is set to be an object-number 
U corresponding to the indicated object. For example, as shown 
0j in Fig- 8, when the object OBI is indicated by clicking on it 
1SL0 with the mouse, the variable "ADDNUM" is set to be u l*\ Then, 
O at step S604, the variable "EDITNUM" is reset to be *0" . 

Figure 21 shows a flowchart for the subroutine SBR7 
CP executed at step S700 of the object-connecting routine shown 
O in Fig, 14. Of course, the execution of the subroutine SBR7 
Ql5 is started when the clicking operation is performed provided 
that the pointer is in the editing-display area CEA. 

At step S701, it is determined whether the clicking 
operation is performed provided that any one of the objects, 
displayed on the editing-display area CEA, is indicated by the 
20 pointer* When it is confirmed that the clicking operation is 
performed provided that the object is indicated by the 
pointer, the control proceeds to step S702, in which it is 
determined whether the variable "MODE" is "1". If MODE = 1, 
i-e, if the obj ect-transf erring/ connecting mode is selected, 
25 the control proceeds to step SHOO, in which a subroutine 
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SBRll is executed. Note, the subroutine SBR11 is explained in 
detail with reference to Fig. 23 Hereinafter. 

At step S702, if MODE * 1, the control proceeds to step 
S703, in which it is determined whether the variable "MODE" is 
5 u 2". If MODE ~2, i,e. if the object-arranging mode is 
selected, the control proceeds to step $1200, in which a 
subroutine SBR12 is executed. Note, the subroutine SBR12 is 
explained in detail with reference to Fig, 24 hereinafter, 
5 At st **P S703, if MODE * 2, i.e. if the object-deleting 

Jlp mode is selected (MODE = 3) , the control proceeds to step 
JJj S1300, in which a subroutine SBR13 is executed. Note, the 
S subroutine 5BR13 is explained in detail with reference to Fig. 
iL 25 hereinafter. 

° n other hand, at step S701, when it is confirmed 

C5 that the clicking operation is performed provided that the 
O object is not indicated by the pointer, the control proceeds 
to step S704, in which it is determined whether the variable 
"MODE" is "2". If MODE - 2, i.e. if the object- arranging mode 
is selected, the control proceeds to step S1400, in which a 
20 subroutine SBR14 is executed. Note, the subroutine SBR14 is 
explained in detail with reference to Fig. 26 hereinafter. 

At step S704, if MODE * 2, the control proceeds to step 
S705, in which, it is determined whether the variable "MODE" is 
u l". If MODE = 1, i.e. if the object- transfer ring/ connecting 
25 mode is selected, the control proceeds to step S1500, in which 
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a subroutine SBR15 is executed. Note, the subroutine SBR15 is 
explained in detail with reference to Fig- 27 hereinafter - 

At step S705, if MODE * 1, i,e- if the object-deleting 
mode is selected (MODE = 3) , the subroutine SBR7 once ends. 
5 Namely, in the object-deleting mode, the clicking operation, 
which is performed provided that the pointer is out of the 
object, is ignored. 

Figure 22 shows a flowchart for the subroutine SBR8 
Ci executed at step S800 of the object-connecting routine shown 
C|0 in Fig, 14- Of course, the execution of the subroutine SBR8 
0 is started when the clicking operation is performed provided 
DO that the completion button CIB is indicated by the pointer, 
p Note, the completion button CIB is operated to end the 
y execution of the object- connecting routine of Fig. 14. 
IF At ste P S801, various object-connection data, obtained 

by executing the object-connecting routine of Fig. 14, are 
suitably processed, and are then stored in the memory medium 
provided in thfc image processing computer system. Then, at 
step S802, the connection-mode scene of the monitor 10, as 
20 shown in Fig. 8, 9, 10, 12 or 13, is returned to the initial 
menu scene (not shown) . 

Figure 23 shows a flowchart for the subroutine SBRll 
executed at step SHOO of the subroutine SBR7 shown in Fig, 
21. Of course, the execution of the subroutine SBRll is 
25 started when the clicking operation is performed provided that 
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the object displayed on the editing -display area CEA is 
indicated by the pointer (S701) , and provided that the object- 
transferring/eonnecting mode is selected (S702 ; MODE = 1) . 

At step S1101, it is determined whether the variable 
5 "ADDNUM" is not "0". If ADDNUM * 0, i.e. if any one of the 
objects, displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1102, in which the variable "EDITNUM" is made 
5 to be object-number corresponding to the object indicated 
JO by clicking on it with the mouse in the editing-display area 
S CEA (S701) . 

At step S1103, a broken-line frame GM is displayed on 
g the editing-display area CEA so as to surround the pointer 
=j displayed thereon. This situation is similar to that shown in 
jj5 Pig. 10. 

U At ste P W101, if ADDNUM = 0, i.e. if any one of the 

objects, displayed on the picture-display area GDA, is not 
indicated by clicking on it with the mouse, the subroutine 
SBR11 once ends. Namely, as long as any one of the objects, 

20 displayed on the area GDA, is not indicated by clicking on it 
with the mouse (ADDNUM = 0) , the indication of the object in 
the editing-display area CEA by clicking on it with the mouse 
(S701) is ignored in the object-transferring/connecting mode 
(MODE = 1) . 

25 Figure 24 shows a flowchart for the subroutine SBR12 
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executed at step S1200 of the subroutine SBR7 shown in Fig. 
21. Of course, the execution of the subroutine SBR12 is 
started when the clicking operation is performed provided that 
the object displayed on the editing-display area CEA is 
5 indicated by the pointer (S701) , and provided that the object- 
arranging mode is selected (S703; MODE = 2) . 

At step S1201, it is determined whether the variable 
"EDITNUM" is u O". If EDITNUM = 0, the control proceeds to step 
S1202, in which the variable "EDITNUM" is made to be an objeet- 
Jp number corresponding to the object indicated by clicking on it 
p with the mouse in the editing-display area CEA (S701) . 
ffl At s te P S1203, a broken-line frame GM is displayed on 

q the editing-display area CEA so as to surround the pointer 
Id disP 1 **"** thereon. Thus, the indicated object concerned can 
Jf be optionally rearranged in the editing-display area CEA, as 
Stated hereinbefore with reference to Figs. 12 and 13. 

At step S1201, if EDITNUM = 0, i.e. if any one of the 
objects, displayed on the editing- display area CEA, has been 
already indicated by clicking on it with the mouse, the 
20 subroutine SBR12 once ends. Namely, the indication of the 
object in the editing-display area CEA concerned is ignored. 

Figure 25 shows a flowchart for the subroutine SBR13 
executed at step S1300 of the subroutine SBR7 shown in Fig. 
21. Of course, the execution of the subroutine SBR13 is 
25 started when the clicking operation is performed provided that 
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the object displayed on the editing-display area CEA is 
indicated by the pointer (S701) , and provided that the object- 
deleting mode is selected (S703; MODE = 3) . 

At step S1301, a set of object-numbers, one of which 
5 corresponds to the object indicated by clicking on it with the 
mouse (S701) , is eliminated from the CEA-list memory area. 
Then, at step S1302, the eliminated set of object-numbers is 
added to the GDA-list memory area* 
5 At step S1303, a display of objects is performed on the 

I|0 picture-display area GDA based on the revised GDA-list memory 
□ area, to which the eliminated set of object-numbers is added* 
3j Then, at step S1304, a display of objects is performed on the 
p editing-display area CEA based on the revised CEA-list memory 
hi area, from which the set of object-numbers is eliminated. Of 
Q5 course, the connecting-strips CNS for successively connecting 
the displayed objects to each other are displayed, whereby 
connection-relationships between the objects can be visually 
recognised. Subsequently, at step S1305, both the variables 
"ADDNUM* and "EDITNUM" are reset to be M 0'\ 
20 Figure 26 shows a flowchart for the subroutine SBR14 

executed at step S1400 of the subroutine SBR7 shown in Fig. 
21. Of course, the execution of the subroutine SBR14 is 
started when the clicking operation is performed provided that 
the pointer is out of the objects on the editing-display area 
25 CEA (S701) , and provided that the object-arranging mode is 
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selected (S704; MODS = 2) . 

At step S1401, it is determined whether the variable 
"EDXTNUM" is not u 0". If EDITNUM ^ 0, i.e. if any one of the 
objects, displayed on the editing-display area CEA, has been 
5 already indicated by clicking on it with the mouse, the 

control proceeds to step S1402, in which the indicated object 
concerned is displayed at the new location to which the 
broken-line frame GM is moved by the pointer on the editing- 
5 display area CEA. 

3° At ate P S1401, if EDITNUM = 0, i.e. if any one of the 

p objects, displayed on the editing-display area CEA, has not 
1 b " n indicated by clicking on it with the mouse, the 
Q subroutine SBR14 once ends. Namely, as long as any one of the 
g objects, displayed on the editing-display area CEA, has not 
g5 been indicated by clicking on it with the mouse, the clicking 
= operation concerned is ignored. 

Figure 27 shows a flowchart for the subroutine SBR15 

executed at step S1500 of the subroutine SBR7 shown in Pig. 

21. of course, the execution of the subroutine SBR15 is 
20 started when the clicking operation is performed provided that 

the pointer is out of the objects on the editing-display area 

CEA, and provided that the object-transferring/connecting mode 

is selected (S705; MODE = 1). 

At step S1501, it is determined whether the variable 
25 "ADDNUM" is not "0". If ADDNOM * 0, i.e.. if any one of the 
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objects , displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1502, in which it is determined whether the 
variable *EDITNUM W is not "0". If EDITNUM * 0, i.e. if any one 
of the objects, displayed on the editing-display area CEA, is 
indicated by clicking on it with the mouse, the control 
proceeds to step S1503, in whieh the scene of the monitor 10, 
as shown in Fig. 10, is changed into the scene as shown in 
Fig- 11/ thereby processing a connection between the object 
indicated in the picture-display area GDA (S1501) and the 
object indicated in the editing-display area CEA (S1502) ♦ 

At step S1504, a pair of pictures (IMS and IM6) , 
represented by the object (OB5) corresponding to the variable 
"EDITNUM" , and a pair of pictures (IM7 and IM8) , represented by 
the object (OB7) corresponding to the variable "ADDNUM", are 
displayed on the monitor 10 , as shown in Pig, 11. Then, at 
step S1505, a movement distance and a rotational angle between 
two target positions (RP1 and RP2) are calculated on the basis 
of designations of image points, representing two connection 
points (RC1 and RC2) , photographed in the two pairs of the 
pictures, as eacplained hereinbefore. 

At step S1506, it is monitored whether the con^letion 
button OFH has been operated by clicking on it with the mouse. 
When the operation of the button OFN is not confirmed, the 
control returns to step S1505. On the other hand, when the 
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operation of the completion button OFN is confirmed, i.e. when 
the calculations are completed, the control proceeds to step 
S1507, in which the scene of the monitor 10, as shown in Fig. 
11, is changed to the scene as shown in Fig. 12. 
5 At S1508, a set of object-numbers, one of which 

corresponds to the object indicated in the picture-display 
area GDA by clicking on it with the mouse (S1501) , is 
eliminated from the GDA-list memory area. Then, at step 
5 S1509, the eliminated set of object-numbers is added to the 
flO CEA-list memory area. 

At step S1510, a display of objects is performed on the 
picture-display area GDA based on the revised GDA-list memory 
p area, from which the set of object-numbers is eliminated, 
g Then, at step S1511, a display of objects is performed on the 
jgp editing-display area CEA based on the revised CEA-list 
« area, to which the eliminated set of object-numbers is added. 
Of course, the connecting-strips CNS for successively 
connecting the displayed objects to each other are displayed, 
whereby connection-relationships between the objects can be 
20 visually recognized. Subsequently, at step S1512, both the 
variables "ADDNUM" and "EDITNUM" are reset to be "0". 

At step S1501, if ADDNUM = 0, i.e. if none of the 
objects, displayed on the picture-display area GDA, is 
indicated by clicking on it with the mouse, the subroutine 
25 SBR15 once ends. Namely, the clicking operation (S701) , which 
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is performed provided that the pointer is out of the object, 
is ignored. 

At step S1501, if ADDNOM * 0, and, at step S1502, if 
EDITNUM =0, i.e, if only one of the objects, displayed on the 
5 picture-display area GDA, is indicated by clicking on it with 
the mouse, the control proceeds from step S1502 to step S1513, 
in which it is determined whether the CRA-list memory area is 
cleared* If the CEA-list memory area is cleared, i.e. if the 
*0 CEA-list memory area stores no object-number, the control 
rjO jumps from step S1513 to step S1508, and the routine 
P comprising steps S1508 to S1512 is executed, whereby only a 
m transfer of objects concerned from the picture-display area 
p GDA to the editing-display area CEA is performed, as explained 
jrj with reference to Figs. 8 and 9. 

3 5 After all the pairs of pictures are successively 

connected to each other by executing the object-connecting 
routine shown in Pig, 14, a routine for producing a survey map 
is executed. In the execution of the survey-map-producing 
routine, a survey map section is produced on the basis of each 

20 pair of pictures, and the survey map sections are connected on 
the basis of the connection data obtained by the execution of 
the object-connecting routine, thereby producing the survey 
map like the one shown in Fig . 1 , 

In the above-mentioned embodiment: , at least three 

25 photographing operations may be performed to produce a survey 
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map section. Of course, in this case, although a set of at 
least three pictures is obtained, in reality, a pair of 
pictures is suitably selected from among the at least three 
pictures for the production of the survey map section. 

Finally, it will be understood by those skilled in the 
art that the foregoing description is of preferred embodiments 
of the system, and that various changes and modifications may 
be made to the present invention without departing from the 
spirit and scope thereof. 

The present disclosure relates to subject matter 
contained in Japanese Patent Application No. 11-188678 (filed 
on July 2, 1999), which is expressly incorporated herein, by 
reference, in its entirety* 
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CIAIMS 



1. An image processing computer system for a 
photogrammetric analytical measurement in which a survey map 
5 is produced by connecting at least two sets of pictures 
featuring a photographed target located at a given target 
position, said system comprising: 

a monitor that displays a scene including a picture- 
display area and an editing-display area; 
J 10 a first monitor controller that selectively displays 

only one picture in each set on said picture-display area of 
said scene ; 

a second monitor controller that transfers a displayed 
picture from said picture-display area to said editing-display 
1 15 area and vice versa; and 

* third monitor controller that visually displays a 
connection relationship between pictures displayed on said 
editing-display area of said scene. 

2 • An image processing computer system as set forth in 
20 claim 1, wherein a display of pictures on said picture-display 
area and said editing-display area is performed at a reduced 



size . 



3, An image processing computer system as set forth in 
claim 1, further comprising a transf er-indicator that 
25 indicates a pieture to be transferred from said picture- 

-66- 



FROM ■ ' 2000$ 6M29B (*) 17: 38/1117: 27/MI4801 158657 P 68 

display area to ©aid editing-display area and vice versa. 

4 . An image processing computer system as set f orth in 
claim 3, wherein a marker is displayed on said editing-display 
area under control of said second monitor controller to 
5 indicate a location, at which the picture is to be transferred 
from said picture-display area to said editing- display area, 
when said picture is indicated by said transfer-indicator* 

5. An image processing computer system as set forth in 
j% claim 4, wherein said marker comprises a frame representing an 
3° outline of the picture to be transferred from said picture- 
S display area to said editing-display area. 

S 6, An image processing computer system as set forth in 

claim 4, wherein said marker is movable under control of said 
second monitor controller on said editing- display area. 

3|5 7. An image processing computer system as set forth in 

u claim 1, wherein a connecting- strip is displayed on said 
editing-display area under control of said third monitor 
controller to indicate said connection relationship between 
the pictures displayed on said editing-display area of said 

20 scene . 

8* An image processing computer system as set forth in 
claim 7 , wherein said connecting- strip is displayed as a strip 
connected between the centers of the two adjacent pictures at 
the back faces thereof. 
25 9. An image processing computer system as set forth in 
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claim 1, further comprising a fourth monitor controller that 
moves a picture, transferred from said picture-display area to 
said editing-display area, from one location to another 
location on said editing-display area. 
5 10. An image processing computer system as set forth 

in claim 9, further comprising a movement-indicator that 
indicates a picture to be moved on said editing-display area* 
11 . An image processing computer system as set forth 
-5 in claim 10, wherein a marker is displayed on said editing- 
rtO display area under control of said fourth monitor controller 
O to indicate a location, at which the picture is to be moved, 
fti when said picture is indicated by said movement- indicator, 
f*! 12, An image processing computer system as set forth 

Tj ±rx claim 11, wherein said marker comprises a frame 
J2jl5 representing an outline of the picture to be moved on said 
^ F editing-display area. 

13 . An image processing computer system for a 
photogrammetric analytical measurement in which a survey map 
is produced by connecting a first group including at least a 
20 set of pictures featuring a photographed target located at a 
first target position and a second group including at least a 
set of pictures featuring a photographed target located at a 
second target position to each other, said system comprising: 
a monitor that displays a fit st scene including a 
25 picture-display area and an editing-display area; 
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a first monitor controller that selectively displays 
only one picture in a set included in said first group and 
only one picture in a set included in said second group, on 
said picture-display area of said first scene; 
5 a second monitor controller that transfers a displayed 

picture from said picture -display area to said editing-display 
area and vice versa; and 

^ a third monitor controller that visually displays a 

connection relationship between pictures displayed on said 

ClO editing-display area of said first scene. 

O 14. An image processing computer system as set forth 

GO ln c 1 *!* 1 13, wherein a display of pictures on said picture- 
O display area and said editing-display area is performed at a 
y reduced size* 

q!5 IS . An image processing computer system as set forth 

in claim 13 , wherein each of said first and second groups 
includes at least two sets of pictures, and all respective 
pictures, included in the sets forming each group, are 
displayed on said picture-display area in photographing order 

20 under control of said first monitor controller. 

16, An image processing computer system as set forth 
in claim 15, wherein, upon transferring one of the respective 
pictures, included in the sets forming each group, from said 
picture-display area to said editing-area and vice versa, a 

25 transfer of the remaining pictures is simultaneously performed 
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under control of said second monitor controller. 

17 . An image processing computer system as set f orth 
in claim 16, wherein, upon transferring one of the respective 
pictures, included in the sets forming each group, from said 
5 picture-display area to said editing-area, a transfer of the 
remaining pictures is simultaneously performed under control 
of said second monitor controller, and all the respective 
pictures, included in the sets forming the other group, are 

yp displayed on said picture-display area under controller of 

,=40 said first monitor controller. 

p 18. An image processing computer system as set forth 

m in claim 13, further comprising a transfer- indicator that 
O indicates a picture to be transferred from said picture- 
Jj display area to said editing-display area and vice versa, 
pip 19. An image processing computer system as set forth 

= ? in claim 18, wherein a marker is displayed on said editing- 
display area under control of said second monitor controller 
to indicate a location, at which the picture is to be 
transferred from said picture-display area to said editing- 
20 display area, when said picture is indicated by said transfer- 
indicator . 

20. An image processing computer system as set forth 
in claim 19, wherein said marker comprises a frame 
representing an outline of the picture to be transferred from 
25 said picture-display area to said editing-display area. 
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21. An image processing computer system as set forth 
in claim 19, wherein said marker is movable under control of 
said second monitor controller in said editing-display area. 

22 . An image processing computer system as set forth 
in claim 13, wherein a connecting-strip is displayed on said 
editing-display area under control of said third monitor 
controller to indicate said connection relationship between 
the pictures displayed on said editing-display area of said 
first scene. 

23. An image processing computer system as set forth 
in claim 22, wherein said connecting-strip is displayed as a 
strip connected between the centers of the two adjacent 
pictures at the back faces thereof. 

24. An image processing computer system as set forth 
in claim 13, further comprising a fourth monitor controller 
that moves a picture, transferred from said picture-display 
area to said editing-display area, from one location to 
another location on said editing-display area. 

25. An image processing computer system as set forth 
in claim 24, further comprising a movement-indicator that 
indicates a picture to be moved on said editing-display area. 

26. An image processing computer system as set forth 
in claim 25, wherein a marker is displayed on said editing- 
display area under control of said fourth monitor controller 
to indicate a location, at which the picture is to be moved, 
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when said picture is indicated by said movement-indicator. 

27. An image processing computer system as set forth 
in claim 26, wherein said marker comprises a frame 
representing an outline of the picture to be moved on said 

5 editing-display area. 

28. An image processing computer system as set forth 
in claim 13, further comprising a connection-indicator that 
indicates a picture, displayed on said picture-display area, 

a and a picture, displayed on said editing-display area, to be 
H-0 connected to each other when the former picture is transferred 

to said editing-display area, 
ft] 29 - iJnag© processing computer system as set forth 

q in claim 28, further comprising a fourth monitor controller 
rj that changes said first scene of said monitor into a second 
gp scene in which a connection-processing for connecting said 

pictures to each other is performed before said former picture 

is transferred to said editing-display area. 

30. An image processing computer system as set forth 
in claim 29, wherein two pictures, included in a set forming 

20 said first group, and two pictures, included in a set forming 
said second group, are displayed on said second scene of said 
monitor under control of said fourth monitor controller for 
said connection -processing. 

31 . An image processing computer system as set forth 
25 in claim 30, wherein said two pictures, included in a set 
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forming said first group, and said two pictures, included in a 
set forming said second group, have at least two common 
eonneeting-image-points for said connection-processing. 

32. An image processing method for a photogrammetric 
5 analytical measurement in which a survey map is produced by 
connecting a first group including at least a set of pictures 
featuring a photographed target located at a first target 
position and a second group including at least a set of 
pictures featuring a photographed target located at a second 

qIO target position to each other, said method comprising steps 

O o£: 

S displaying a scene, including a picture-display area 

^ and an editing-display area, on a monitor; 
y selectively displaying only one picture in a set 

||5 included in said first group and only one picture in a set 

included in said second group, on said picture-display area of 

said scene; 

transferring a displayed picture from said picture- 
display area to said editing-display area; and 
20 visually displaying a connection relationship between 

pictures displayed on said editing-display area of said scene. 

33. A memory medium storing an image processing 
program for a photogrammetric analytical measurement in which 
a survey map is produced by connecting a first group including 
25 at least a set of pictures featuring a photographed target 
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located at a first target position and a second group 
including at least a set of pictures featuring a photographed 
target located at a second target position to each other , said 
program featuring steps of: 
5 displaying a scene, including a picture-display area 

and an editing-display area, on a monitor; 

selectively displaying only one picture in a set 
included in said first group and only one picture in a set 

C included in said second group, on said picture-display area of 

QO said scene; 

Q transferring a displayed picture from said picture- 

ffl display area to said editing-display area; and 
□ visually displaying a connection relationship between 

y pictures displayed on said editing-display area of said scene. 
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* 

IMAGE PROCESSING COMPUTER SYSTEM 
FOR PHOTOGRAMMETRI C ANALYTICAL MEASUREMENT 

5 ABSTRACT OF THE DISCLOSURE 

In an image processing computer system for a 
photogrammetric analytical measurement in which a survey map 
y is produced by connecting a first group including at least a 
jiio set of pictures featuring a photographed target located at a 
"2 first target position and a second group including at least a 
yp sQfc Q f pictures featuring a photographed target located at a 

second target position to each other, a monitor displays a 
EP scene including a picture-display area and an editing-display 
Ol5 area. On the picture-display area, only one picture in a set 
O included in said first group and only one picture in a set 
included in said second group are selectively displayed. A 
displayed picture is transferred from said picture-display 
area to said editing-display area and vice versa* Connection 
20 relationships between pictures are visually displayed on the 
editing-display area. 
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Declaration and Power of Attorney For Utility or Design Patent Application 

Japanese Language Declaration 



As a beiow named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stared 
beiow next to my name. 

I believe 1 am the original, first and sole inventor (if only one name is 
listed beiow) or an original, first ana join? inventor (if plural names 
are listed beiow) of" the subject matter which is claimed and for 
which a patent is sought on the invention entitled 

IM&GE PROCESSING CCMFUTER SYSTEM FOR 

PHQTOGRAMMETRIC ANALYTICAL MEASUREMENT 



O 



the specification of which 

(check one) 

tZl is attached hereto. 



□ was filed on . 



. as 



Application No. 



and was amended on 



(if applicable) 

I hereby state that i have reviewed and understand the contents of 
the above Identified specification, including the claims, as amended 
by any amendment referred to above, 

I acknowledge the duty to disclose information which is matenat to 
the examination of this application in accordance with Title 37, Code 
of Federal Regulations, §1 .58. 

1 hereby claim foreign prionty benefits under Title 35. United States 
Code §1 19(a-d) or §365{b) of any foreign appJication(s) for patent 
or inventor's certificate, or §365(a) of any PCT international 
application which designated at feast one country other than the 
United States of America, listed below and have also identified 
oeJow, by checking the **No" box, any foreign application for patent 
Or inventor's certificate, or of any PCT international application having 
a filing date before that of the application on which pnoricy ts claimed: 



Prior foreign applications 

Pll-188678 
iNumber) 



(Number) 



(Number) 



JAPAN 



(Country) 
(L4K) 



(Country) 



(Country) 
(fflS) 



02/July/1999 



{Day/Month/Year Filed) 



Priority claimed 

a □ 



(Oay/Month/Year Red) 



{Oay/Month/Year Fried) 



Yes 

□ 

Yes 

□ 
Yes 



NO 
□ 

No 

□ 

NO 
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Japanese Language Utility or Design Patent Application Declaration 



(Number) 



{Number} 



(Number) 



(Application No.} (Day/Month/Year Fited) 



(Application No.} (Day/Month/Yaar Filed) 

(taw**?) (as*«MB) 

1-5, 

3tf>*rr 5** & i sr s^^i'seoTfro *:*a* * * t *a 
c, as(c«c«a<73isBaw*i ! ?- 3 fti»^ £*fflifc**i8«eiooi* 

£ Jt39»ji» a sestet £SQkf^ a ssna^Wat * u t rft^ 
L W»SWf i-X W 6 ft 5 v ^ * a tf »irw u x , IBI*S#ai-l:XttKW 



□ Additional foreign application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35. United Scares Code § 1 1 9(e) 
of any United States provisional application(s) listed beiow. 



□ Additional provisional application numbers are listed on a 
supplemental priority sheet attached hereto. 

I hereby claim the benefit under Title 35. United States Code §120 
of any United States appiication(s), or §355{c) of any PCT 
international application designating the United States of America, 
listed beiow and, insofar as the subject matter of each of the claims 
of this application is not disclosed in the pnor united States or PCT 
international application in the manner provided by the first 
paragraph of Title 3S. United States Code §112. 1 acknowledge the 
duty to disclose information which is material to patentability as 
defined in Title 37. Code of Federal Regulations §1 .56 which became 
available between the filing date of the prior application and the 
national or PCT international filing date of this application. 



(WiS) (Status) 

(patented, pending, abandoned) 



(W>«) (Status) 
(IMTiS*- ffiSSfA) (patentad. pending, abandoned) 

□ Additional U.S. or international application numbers are fisted 
on a supplemental priority sheet attached hereto. 

1 hereby declare that ail statements made herein of my own 
knowledge are true and that ail statements made on information 
and belief are believed to be true; and further that these statements 
were made with the knowledge that willful false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such 
willful false statements may jeopardize the validity of the application 
or any patent issued thereon. 

The undersigned hereby authorizes the U.S. attorney or agent 
named herein to accept and follow instructions from either his foreign 
patent agent or corporate representative, if any, as to any action to 
be taken in the Patent and Trademark Office regarding this 
application without direct communication between the U.S attorney 
or agent and the undersigned. In the event of a change in the 
persons rrom whom instructions may be taken, the U.S. attorney 
or agent named herein will be so notified by the undersigned. 



{Day/Momn/Yaar Filed) 



(Day/Month/Year Filed) 



(Oay/Month/Year Red) 
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Japanese Language Utility or Design Patent Application Declaration 



B?Sf 7055 

N"eil F. Green blum 
Bruce H. Bernstein 
fg ' Roger P. Glass 

JJi James L. Rowland 

iS" Arnold Turk 



POWER OF ATTORNEY: As a named inventor . I hereby appoint 
the artomey(s) and/or agent(s) associated with the Customer 
Number provided below to prosecute this application and 
transact all outness in the Patent and Trademark Office 
connected therewith, and direct that all correspondence be 
addressed to that Customer Number: 

CUSTOMER NUMBER 7055 

The appointed attorneys presently include: 

Reg. No. 28.394 
Reg. No. 29,027 
Reg. No. 30.841 
Reg. No. 32.674 
Reg. No. 33.094 



Address: GREENBLUM 4k BERNSTEIN, PX.O 

1941 ROLAND CLARKE PLACE 
RESTON, VA 20191 



Direct Telephone Caiis to: (name and telephone number) 



GREENBLUM & BERNSTEIN, PX.C- 

(703)716-1191 





Rill name of sole or first inventor 
Toshihiro NAKAYAMA 






Inventor's signature Date 

"Tcdtffa m ^ IcA v/f rWfi 30 O 




ReSsidenca r 

Saitama, Japan 


mm 


Citizenship 
JAPAN 




Post Office Address 

C/o ASAHI KOGAKU KOGYO KABUSHIKI KAISHA 




36-9, Maenoctio 2-chcme , 
Itabashi-ku , Tokyo „ Japan 




Full name of second joint inventor, if any 




Bit 


Second Inventor's Signature Date 


EE* 


Residence 




Citizenship 




Post Office Address 


i 





<&*2&**tLiu&njSmy&f919tztt LT 6 Jnj**£t8« (Supply simi/ar information and signature for tn/rp and 

£f £ t>*9 S £ fti&T 5 Z t « ) subsequent joint inventors,) 
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